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(57) ABSTRACT 

An icon display processor for use in a computer permits a 
user to intuitively recognize sub-data embedded in, or linked 
to, main data while a main icon symbolizing the main data 
is being displayed. When data B and C are embedded in 
document A, if a main icon is displayed, sub-icons corre- 
sponding to the embedded data are displayed behind the 
main icon. Thus, the user can intuitively recognize the 
sub'data contained in the document A. A sub-icon is dis- 
played for each item or kind of sub-data. The user can 
directly process the sub-icons. 
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FIG.20 

^ 

DOCUMENT FILE FOR MAIN DATA 

< DOCUMENT > 

< File Name > "Document A" < /File Name > 

< BODY OF TEXT > 

< CHAPTER > 

Report results of statistical processing. 

< Table > "Table B.XIs" < /Table > 

The results are the same as shown in the table above. 

< /CHAPTER > 

< CHAPTER > 

It can be seen from the foregoing that this is excellent. 

< /CHAPTER > 

< /BODY OF TEXT > 

< /DOCUMENT > 
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ICON DISPLAY PROCESSOR FOR for each kind of sub-data. Where a sub-icon is displayed for 

DISPLAYING ICONS REPRESENTING SUB- each item of sub-data, the user can easily recognize the 

DATA EMBEDDED IN OR LINKED TO MAIN number of sub-data items or their order. Where a sub-icon is 

ICON DATA displayed for each kind of sub-data, the user can readily 

5 recognize the kinds of sub-data contained. 

Preferably, a mode selector unit is provided for permitting 

BACKGROUND OF THE INVENTION the user to choose between a close display mode in which 

^ ij r T plural sub-ic3ons are displayed so as to overlap with each 

1. Field of the Invention . • * j j ■ J- ^ ^ a 

other m a congested manner and an expansion display mode 

The present invention relates to an icon display processor jo in which plural sub-icons are displayed so as to overlap with 

for displaying and processing icons used on computer dis- ^^^^ ^^^^j, ^lut in a less congested manner. In the close 

plays and, more particularly, to a method of displaying icons display mode, the area of display is reduced and thus the 

representing sub-data (i.e., objects or contents) embedded in, ^^^^^y ^^ea can be utilized efficiently. In the expansion 

or linked to, main data (e.g., a document). ^-^^^^^ ^^^^^ presence of each sub-data item can be 

2. Description of the Related Art 15 represented more clearly^ 

When a list of documents is displayed with the conven- 
tional icon display processor, an icon is displayed for each 
document. The icon symbolizes the document. Using such 

icons, the user can select documents and perform operations a^SjuStfiSBSEScE^ 
(e.g., copying) on the documents. ^0 ^^^^ display ^processor may have a program - 
In recent years, it has become possible to embed various activating unit that activates an application program corre- 
kinds of data as document parts in this document or to link spending to the sub -icon by performing given processing on 
various kinds of data. For instance, image data and graphical the sub-icon. This application program processes the sub- 
data can be inserted in text data. Furthermore, voice and data represented by the sub-icon. 

motion pictures can be inserted. These kinds of data will structure has the advantage that the application 

herein be referred to as sub -data and are generally managed program associated with the sub-data can be directly acti- 

as files separate from the main data. Techniques regarding vated without once activating the application program asso- 

icons are disclosed in Japanese Unexamined Patent Publi- ciated with the main data. Consequently, the cumbersome - 

cation Nos. 7-210360 (1995) and 6-28145 (1994). ness of the operations can be alleviated. Furthermore, the 

With the prior art processor, icons representative of docu- time taken to open the sub-data can be reduced. In addition, 

ments are simply displayed. Presence or absence of data evenif any application program for processing the main data 

(objects or contents) contained in a document or their kinds is not present, the sub-data can be directly operated, 

cannot be confirmed unless the document is once opened. The icon display processor may have a copy unit that 

For the same reason, it is impossible to gain direct access to ^5 copies sub-data represented by the sub-icon when given 

independent data items within a document while an icon for processing is performed on the sub-icon. When the main 

the document is being displayed. icon moves, the sub-icon follows it. However, the sub-icon 

can be operated independent of the main icon. 

SUMMARY OF THE INVENTION ^ object managing table may be formed for each mai^ 

In view of the foregoing problems with the prior art 40 data item to manage the kinds and the sequence of th^ 

technique, the present invention has been made to provide an sub-data items. 

icon display processor permitting a user to intuitively rec- Multimedia data contains various kinds of data such as 

ognize sub-data embedded in, or linked to, main data while texts, graphics, images, motion pictures, and voices. Where 

an icon for the main icon is being displayed. the sub-icons as described above are displayed, if multime- 

Iho present invention also provides an icon display dia data are represented by icons, the data structure can be 

process or permitting a user to directly handle sub-data visualized. Therefore, the user can inmitively recognize the 

embedded in, or linked to, the main data while an icon for and proportions of data contained. Before the data are 

the main data is being displayed. opened, the sound volume and the resolution can be 

The icon display processor according to the present adjusted. ^ , . 

invention has a main icon display unit that displays a main ^ O^^^^ ^^jjects and features of the invention wdl appear m 

icon representative of main data, and a sub-icon display unit course of the description thereof, which follows, 

that displays a sub-icon representative of sub^Iata together BRIEF DESCRIPTION OF THE DRAWINGS 
with the main icon if the sub-data form a part of the main 

data and are embedded in, or linked to. the main data. The invention will be described with reference to the 

, . £ . ^. . . . r «i. following drawings, wherein like numerals designate like 

In this configuration, the sub-icon representative of the , ... 

. , ^ J r • -4 ^- .u • J 4 • J- 1 A elements, and wherein: 
sub-data and forming a part of the mam data is displayed 

while the main icon is being displayed. TTiis permits the user PIGS. 1(A)-1(C) show an example of file structure and 

to recognize the presence of the sub-data. That is, since the examples of display of sub-icons; 

sub-icon is displayed, the user can intuitively recognize the FIG. 2 is a view showing an example of compositional 

structure of the main data. The sub-icon may be identical in display of sub-icons; 

size to or smaller than the main icon. FIG. 3 is a view showing an example of parallel display 

llie sub-icon described above may be displayed close to of sub-icons; 

the main icon, or the sub-icon is displayed such that it FIG. 4 is a view showing an example of overlap display 

appears partially from behind the main icon. 55 of small sub-icons; 

llie aforementioned sub-icon may be displayed for each FIG. 5 is a view showing a parallel display of small 

sub-data item. Alternatively, the sub-icon may be displayed sub-icons; 
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FIG. 6 is a view showing an example of combination 
display of sub-icons; 

FIG. 7 is a view showing an example of page-based 
display of sub-icons; 

FIGS. 8(A) and 8(B) show an example of individual ^ 
display mode and an example of category-based display; 

FIGS. 9(A) and 9(B) show a normal display mode and an 
expansion display mode; 

FIG. 10 is a view showing forms of icons according to iq 
kinds of data; 

FIGS. 11(A)-11(C) show examples of display of sub- 
icons; 

FIG. 12 is a view illustrating an opening operation on a 
sub-icon; 

FIG. 13 is a view illustrating an operation on a subicon 
when a copy is made; 

FIG. 14 is a view showing a display of an editing menu 
corresponding to a sub-icon; 

FIG. 15 is a view illustrating an operation for changing 
the order of sub-icons; 

FIG. 16 is a block diagram of an icon display processor 
in accordance with the present invention; 

FIG. 17 is a table of an example of an object managing 25 
table; 

FIG. 18 is a flowchart illustrating a routine for creating the 
object managing table shown in FIG. 17; 

FIG. 19 is a flowchart illustrating a routine for displaying 
icons; and "'^ 

FIG. 20 is a view illustrating an example of document file 
for main data. 

DESCRIPTION OF THE PREFERRED 

EMBODIMENTS 35 

Referring to FIG. 1, an example of display of icons 
provided by an icon display processor in accordance with 
the present invention is shown. A document structure regard- 
ing a document A that is main data is shown in FIG. 1(A). 
FIG. 1(B) indicates an example of display of icons in a 
normal display mode. FIG. 1(C) indicates an example of 
display of sub-icons in accordance with the invention. 

As shown in FIG. 1(A), the document A is composed of 
data across plural pages (text data). For example, in the first 45 
page, data B and C are embedded as sub-data. For instance, 
the embedded data B is graphical data, and embedded data 
C is image data. Generally, these embedded data B and C are 
managed by a file different from the document A. However, 
if the document A is opened on an application software, 50 
these embedded data B and C are displayed as parts of the 
document A. In some cases, data may not be embedded in a 
document but rather other data forming parts of the docu- 
ment data is linked to that document. The invention can also 
be applied to such linked data. 55 

In the conventional normal display mode in FIG. 1(B), a 
document icon 10 is displayed for each document. This does 
not permit the user to recognize the sub-data contained in the 
document A. On the other hand, in a display of sub-icons 
shown in (C), the document icon 10 is accompanied by 60 
sub -icons 12 and 14, which symbolize the embedded data B 
and C, respectively. 

The display of sub-icons shown in FIG. 1(C) has the 
advantage that the user can immediately know what sub-data 
are contained in the main data because the main icon and one 65 
or more sub-icons are displayed as a group. Furthermore, the 
sub-icons 12 and 14 can be handled independently as 
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described later. Various examples of display of sub-icons are 
shown in RGS. 2-7, HGS. 8(A) and 8(B), and FIGS.9(A) 
and 9(B). 

FIG. 2 shows an example of display of sub-icons similar 
to the example of display of sub-icons shown in FIG. 1. In 
this example of display, the sub-icons 12 and 14 are dis- 
played in the same size as the main icon 10. FIG. 3 shows 
an example of parallel display of sub-icons. The main icon 
10 is at the left end. To the right, one or more sub-icons 12, 
14 are displayed. In this way, sub-icons are displayed in an 
overlapping or close relation to the main icon. The close 
positional relations between the icons enables the user to 
intuitively recognize the dependent relation of the sub-icons 
to the main icon. 

In FIG. 4, small sub-icons are displayed so as to overlap 
with each other. That is, sub-icons 12' and 14' smaller than 
a main icon 10 are displayed. This accentuates the relation 
between the main icon and the sub-icons. In FIG. 5, small 
sub -icons are displayed in a parallel relation. This clearly 
represents the relation between the main icon and the 
sub -icons in the same way as in the example of display 
shown in FIG. 4. 

In the example of combination display shown in FIG. 6, 
plural sub-icons 12, 14 are displayed parallel behind the 
main icon 10. This example of display also represents the 
relation between the main icon and the sub- icons more 
clearly. 

FIG. 7 shows an example of display in which different 
sub-icons are displayed for different pages. In particular, 
sub-icons 22-30 are displayed for different pages behind the 
main icon 10. The two sub-icons 22, 24 corresponding to 
two sub-data items are displayed in the first page. Similarly, 
other sub-icons are displayed in the following pages. Thus, 
this example of display permits the user to grasp the number 
of sub-data items contained in each page and their kinds. 

FIGS. 8(A) and 8(B) show two display modes. Shown in 
FIG. 8(A) is an individual display mode in which sub-icons 
32-42 are displayed for each sub-data item. Shown in FIG. 
8(B) is a category-based display mode in which sub-icons 44 
and 46 are displayed for each category of sub-data contained 
in a document, llie individual display mode allows the user 
to grasp the sequence and number of sub -data items con- 
tained in the document. The category-based display mode 
permits the user to grasp every category of sub-data con- 
tained in the document. 

A reduction display mode that is a normal display mode 
is shown in FIG. 9(A). An expansion display mode is shown 
in FIG. 9(B). In the reduction display mode, plural sub -icons 
48-58 are displayed closely and obliquely from the left 
bottom end to the right top end behind the main icon 10 such 
that they overlap with each other. In the expansion display 
mode shown in FIG. 9(B), the icons are displayed essentially 
in the same format but with an increased spacing. That is, the 
array of the icons are elongated obliquely. The reduction 
display mode makes it possible to utilize the finite display 
area efficiently. The expansion display mode permits the 
user to recognize individual icons clearly. In the normal 
reduction display mode, only the file name of the main data 
is displayed together with the main icon 10. On the other 
hand, in the expansion display mode, the file names of 
individual sub-data items are displayed close to the sub- 
icons along with the file name of the main data. Of course, 
the processor may be designed in such a way that the user 
can choose whether these file names arc displayed or not. 

FIG. 10 shows an example of display in which a different 
icon is displayed for each different kind or category of data. 
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This permits the user to intuitively recogpize the kinds of A file corresponding to the main data and files corre- 

data when he or she views the main icon and the sub-icons, spending to sub-data are stored in the data storage section 

Of course, each icon may symbolize an application program 210. In the present embodiment, an object managing table 

linked to data. 214 is organized. 

In FIG, 11(A), only a main icon 72 is shown. Under this 5 Referring to FIG. 17, there is shown a specific example of 

condition, it is impossible to recognize the kind of data object managing table 214. This table 214 is created for 

contained in multimedia data symbolized by the main icon. ^^^^ ^^^^ -^^^ ^j^^^ ^^-^^^ managing table 214, the 

With the sub-icon display method described above, a display ^^.^ ^^^^ .^^^^ ^ ^^^^ ^ 

as shown in FIG. 11(B can be pravided, and the user can ^ ^ the presence or absence of 

recognize the kinds of data contained m the main data m 1 *i. j r*u • *L •* j * * 

symbolized by the main icon 72 because sub-icons 74-78 d^play, the order of the icons, the c^^ 

symbolize the contained data. SpecificaUy, the user can of thumbnads are associated as attributes witfi each object, 

intuitively recognize that tables and graphics are contained ^h^ order of the icons mdicate the turns of display of main 

in text data and that sound is added. Therefore, where a icon and sub-icons. Ord er 0 indic ates t he main ico n. In th e 

display is provided as shown in FIG. 11(B), if the user cUcks present^mbodiment, tffe user cmgho^^^^ 

on ±e sub-icon 78, sub-data can be played back as voice sub-iton^bouldjbfe^is^ 

data without opening the main icon 72. Where a display is When the main data and sub-data symboUzed by their 
provided as shown in FIG. 11(C), plural sub-icons 80-^8 respective icons are referenced, the file type inside the object 
permit the user to recognize that numerous movies are managing table 214 is referenced. An application program 
contained in the text. Then, the user can make preparations corresponding to the file type is executed, 
for the next action, e.g., the display is switched to a higher FIG. 18 illustrates a routine for creating the object man- 
resolution mode. aging table. This routine is automatically carried out when a 
Examples of handling of icons in an icon display proces- new document is read in or received or when the user has 
sor in accordance with the present invention are shown in performed given processing. 

FIGS. 12-15. Referring to FIG. 12, if the user double-clicks Step 101 and the following steps are carried out to create 

a certain sub-icon, an application program associated with an object managing table for each document or to update the 

sub -data symbolized by the sub-icon is activated. That is, a table. If a document is selected, and if an object managing 

window 100 is opened. Graphics data 102 corresponding to table 214 corresponding to the document exists, this object 

th e sub-data is re presented within the window 100. manaeine table is edited. If any table is not present, a new 

object managing table is created. 
In step 102, the document selected in step 101 is treated 

^If^ll^f^^mg^^'ii^m^fm^^^'^^' ^^^^ document in the main data is analyzed, 

f^fernng" next to FIG. t47"if a cerSin operation (e.g.. Thus, objects that are sub-data contained in the main data are 

right-clicking) is performed on a certain sub -icon, an editing extracted. 

menu 104 is displayed. If a desired option item is selected 35 step 103, the objects extracted in step 102 are analyzed, 
from the menu, a desired operation can be pe^r^d^^^^ ^nd information about the file types and capacities of the 
3^'^'^^^iiL!° ^ !!■ ^^ ^^^^^^ objects is obtained. 

1° ^^^P d^t^ ^^0^^ objects extracted based on the 

-fPg^l^J^^Jl^S^^^^^ results of analysis made in step 103 are sequentially put into 

^^t^^M^Mft* ' change the turn of the 40 jhe object managing table 214. In the initial setup, data about 

sub-icon as shown to the right of the figure. The processor ^^der of icons is put into the table in the order in which 

may be so designed that the user can choose whether the turn j^^^ ^bout the objects are put into the table as mentioned 

of insertion of the sub-data symbolized by the sub-icon is previously. 

changed. ^^^p ^^^^ ^ decision is made as to whether other objects 

Ad icon display processor in accordance with the present 45 are contained in the main data. The above-described steps 

embodiment is next described by refernng to FIG. 16. 'This repeated until data about all the objects in the main data 

processor can be built in a computer, for example. The icon completely entered into the table, 

display processor has an internal bus 200 with which a CPU ,^ ^ ^^^^^^ ^ ^^^^ ^ ^^^^^^^ ^^^^^ 

202 for execuung programs and arithmetically processmg ^^^^^ ^^^^^^^ ^^^^^^ 

data IS connected. An mput section 204 comprising a key 50 , . . 

board and a mouse, for example, is connected with the 1° ^^he present embodiment, object managmg tables are 

internal bus 200. A display portion 206 is connected with the ^f^^'f^ °J updated for aU documents This processmg may 

internal bus 200 and made of a display device or the like. A ^^^^ ^ o°*y ^ document mdicated by the user, 

program storage section 208 and a data storage section 210 Processmg for extracting objects from a document that is 

are each made of a RAM, a ROM, a hard disk, or other 55 ^^^^ creating or updating an object managing 

storage device. In FIG. 16, they are shown as two storage table is described in detail below. In the present 

sections 208 and 210, for convenience. embodiment, it is assumed that the document consists of 

An OS (operating system) and various application pro- elements tagged as shown in BG. 10. 

grams are stored in the program storage section 208. In Each document element is represented by being sur- 

addition, an icon control program 212 and an icon 60 rounded by a given tag and a corresponding terminal tag. For 

display ing-and -processing program 213 are stored. The icon example, table B is given by 

control program 212 is used to execute processing when ^. , , „ ^, „ ^ . , 
icons are operated as shown m FIGS. 12-15. The icon 

display ing-and-processing program 213 is employed to Objects can be extracted by analyzing the document 

carry out processing associated with display of icons as 65 written in this way and finding tags corresponding to the 

shown in FIGS. 2-11. lliat is, the main icon and the objects. 

sub-icons are displayed integrally. In step 101, a document to be processed is selected. 
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If "Table B.Xls" that is an object for a graph is extracted 
in step 102, the processor interrogates the operating system 
about the attributes of the file of "Table B.Xls". Thus, 
information such as file type "Xls" and file capacity "15 
KB" is obtained (step 103). 5 

In step 104, information (i.e., file name "table B", file type 
"Xls", and file capacity "15 KB") regarding the object 
"Table B.Xls" obtained in the above -described step is added 
to the object managing table. In the initial setup, a new order 
is given whenever new information about an object is added, lo 
The "display" is set to "YES". 

Because of the steps described thus far, an object man- 
aging table is created or updated. Steps 105 and 106 are 
performed to make a decision as to whether there is any 
other document to be processed. In this way, all documents 15 
are processed. 

FIG. 19 illustrates an icon displaying-and-processing rou- 
tine. This routine is executed whenever a main icon is 
displayed. 

In step 201, the object managing table is referenced. In 20 
step 202, display of the main icon and sub-icons is carried 
out according to preset display conditions (display mode and 
display rules). In step 203, a decision is made as to whether 
there is any other main data. The steps described thus far are 
repeated for all main data items. 25 

In step 202 described above, if an overlap display mode 
is selected as shown in FIG. 2, the icon displaying-and 
processing program 213 illustrated in FIG. 16 is processed 
in the manner described below. 

An object managing table corresponding to the document 30 
of main data to be displayed is referenced. A sub-icon for an 
object having a maximum value of "order" in the object 
managing table is displayed. 

Then, a sub-icon for an object that is next in the value of 
"order" in the reverse direction is displayed in an incremen- 35 
tally shifted position. That is, this sub -icon overlaps with the 
former sub-icon. The displayed position is shifted to the left 
and in the downward direction in an increment. 

This processing is performed to display sub-icons in turn 
in the reverse direction to the order in the object managing 40 
table. Finally, processing for displaying the main icon at the 
obliquely shifted, left bottom position is carried out. 

That is, the icons are displayed so as to overlap with each 
other. Therefore, the main icon is displayed in the forefront, 
i.e., priority is given to this main ion. Where the parallel 45 
display mode as illustrated in FIG. 3 is selected, a main icon 

an4.sub -isoDS^re displayed in turn. 

j^^li&jb!| faft? t|^^^ 
^ ^^^ ^mjiVtSjiieBS^ 

tnajg^P^Sj^ If necessary, a title maybe displayed for 50 
each icon. 

Where the number of icons to be displayed is in excess of 
a given value, the display method maybe automatically 
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changed. For example, even if the expansion display shown 
in FIG. 9(B) is selected, normal display as shown in FIG. 
9(A) may be provided. 

The main icon and sub-icons in the present embodiment 
may symbolize the contents of the files. Alternatively, they 
may be reference icons consisting only of reference icons 
indicating the locations at which the files are loaded. 

As described thus far, the present invention permits a user 
to intuitively recognize sub -data embedded in, or linked to, 
main-data while a main icon for the main data is being 
displayed. Furthermore, the sub-data embedded in, or linked 
to, the main data can be directly handled. 

What is claimed is: 

1. An icon display processor comprising: 

a main icon display unit that displays a main icon repre- 
sentative of main data; 

a sub-icon display unit that displays sub-icons represen- 
tative of sub-data together with the main icon where the 
sub-data form parts of the main data and are embedded- 
in, or linked-to, the main data; and 

a mode-selecting unit that chooses between a close dis- 
play mode in which plural sub-icons are displayed so as 
to be located densely and overlap with each other and 
an expansion display mode in which plural sub-icons 
are displayed so as to be located less densely and 
overlap with each other. 

2. The icon display processor of claim 1, wherein the 
sub-icons are displayed close to the main icon. 

3. The icon display processor of claim 1, wherein the 
sub-icons displayed are located behind the main icon and 
overlap with the main icon. 

4. The icon display processor of claim 1, wherein each of 
the sub-icons is displayed for each item of sub-data. 

5. The icon display processor of claim 1, wherein each of 
the sub-icons is displayed for each kind of sub-data. 

6. The icon display processor of claim 1, wherein the 
sub-icons assume forms corresponding to kinds of the 
sub -data. 

7. The icon display processor of claim 1, wherein there is 
fiirther provided a program- activating unit that, when given 
processing is performed on one of the sub-icons, activates an 
application program corresponding to the sub-icon, and 
wherein the apphcation program processes sub-data sym- 
bolized by the sub-icon. 

8. The icon display processor of claim 1, further com- 
prising a copying unit that, when given processing is per- 
formed on one of the sub-icons, copies sub-data symbolized 
by the sub -icon. 

9. The icon display processor of claim 1, wherein an 
object managing table is formed for each item of the main 
data to manage kinds and order of sub-data items. 

♦ * * * * 
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